Evolution of Complex Autonomous Robot Behaviors using Competitive Fitness
نویسنده
چکیده
Evolutionary Robotics (ER) employs population-based artificial evolution to develop behavioral robotics controllers. In this paper we focus on the formulation and application of a fitness selection function for ER that makes use of intra-population competitive selection. In the case of behavioral tasks, such as game playing, intra-population competition can lead to the evolution of complex behaviors. In order for this competition to be realized, the fitness of competing controllers must be based mainly on the aggregate success or failure to complete an overall task. However, because initial controller populations are often subminimally competent, and individuals are unable to complete the overall competitive task at all, no selective pressure can be generated at the onset of evolution (the Bootstrap Problem). In order to accommodate these conflicting elements in selection, we formulate a bimodal fitness selection function. This function accommodates sub-minimally competent initial populations in early evolution, but allows for binary success/failure competitive selection of controllers that have evolved to perform at a basic level. Large arbitrarily connected neural network-based robot controllers were evolved to play the competitive team game Capture the Flag. Results show that neural controllers evolved under a variety of conditions were competitive with a hand-coded knowledge-based controller and could win a modest majority of games in a large tournament.
منابع مشابه
Evolution of Complex Autonomous Robot Behaviors
Evolutionary Robotics (ER) employs population-based artificial evolution to develop behavioral robotics controllers. In this paper we focus on the formulation and application of a fitness selection function for ER that makes use of intra-population competitive selection. In the case of behavioral tasks, such as game playing, intra-population competition can lead to the evolution of complex beha...
متن کاملCompetitive Relative Performance and Fitness Selection for Evolutionary Robotics
Nelson, Andrew Lincoln. Competitive Relative Performance and Fitness Selection for Evolutionary Robotics. (Under the direction of Dr. Edward Grant.) 1 Evolutionary Robotics (ER) is a field of research that applies evolutionary computing methods to the automated design and synthesis of behavioral robotics controllers. In the general case, reinforcement learning (RL) using high-level task perform...
متن کاملCooperative and Competitive Behavior Acquisition for Mobile Robots through Co-evolution
This paper discusses how multiple robots can emerge cooperative and competitive behaviors through co-evolutionary processes. A genetic programming method is applied to individual population corresponding to each robot so as to obtain cooperative and competitive behaviors. The complexity of the problem can be explained twofold: coevolution for cooperative behaviors needs exact synchronization of...
متن کاملEvolution of behaviors in autonomous robot using artificial neural network and genetic algorithm
In distributed autonomous robot (agents) systems, each robot (predator or prey) must behave by itself according to its states and environments, and if necessary, must cooperate with other robots in order to carry out a given task. Therefore it is essential that each robot have both learning and evolution ability to adapt to dynamic environment. This paper proposes a pursuing system utilizing th...
متن کاملEvolution of neural controllers for competitive game playing with teams of mobile robots
In this work, we describe the evolutionary training of artificial neural network controllers for competitive team game playing behaviors by teams of real mobile robots. This research emphasized the development of methods to automate the production of behavioral robot controllers. We seek methods that do not require a human designer to define specific intermediate behaviors for a complex robot t...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2003